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Recursive Identification and Tracking of Parameters for Linear and 
Nonlinear Multivariable Systems 

* 

Menahem Sidar 


ABSTRACT 

The problem of identifying constant and variable parameters in 
multi-input, multi-output, linear and nonlinear systems is considered, 
using the maximum likelihood approach. An iterative algorithm, 
leading to recursive ider.tif Icstion and tracking of the unknovm 
parameters and the noise covariance matrix, is developed. Agile 
tracking, and accurate and unbiased identified parameters are obtained. 
M-scessary conditions for a globally, asymptotically stable identifi- 
cation process are provided; the conditions proved to be useful and 
efficient. Among different cases studied, the stability derivatives 
of an aircraft were identified and some of the results art; shown as 
examples. 

1. Introduction 

It has been recognized during the last several years that on-line 
recursive identification and tracking of unknown, time-varying 
parameters in linear and nonlinear dynamical systems is of paramount 
importance. Valuab'*e algorithms that operate on recorded input- 
output time histories over finite time intervals have been reported 
for the batch identification of constant system parameters (Astrom 

* 
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•nd Eykhoff, .1971 and Mehra, 1974). The relatively few recursive 
schemes reported to date (such as Hastings and Sage, 1969 and Certler 
and Banyasz, 1974, for examp'e) are applicable only to linear systemH 
and, even there, probably not to high order, multivariable linear 
systems. Neither the batch nor the available recursive algorlthns 
can be used In many problems of aeronautical Interest. For example. 
Identification of aircraft engine parameters, of aircraft stability 
and control derivatives In high angle-of-attack or accelerated 
flight, of atmospheric perturbations that vary through the flight 
regime — all require nonlinear or time-varying parameter tracking 
capability. 

Tnls paper adopts the maximum likelihood approach to provide 
a robust technique to satisfy the above aeronautical needs. An 
on-line recursive algorithm in developed for the simultaneous 
Identification and tracking of unknown variable parameters. It 
Is shown that the resulting scheme satisfies several guidelines: 

It provides and tracks unbiased estimated for multlpararoeter llneai 
and nonlinear systems; It is computationally simple; and. It is 
usable on line. 

After formulating the identification problem In section 2, 
the estimation criterion and the identification scheme are selected 
in section 3. Because our main goal is to devel ' an on-line 
Identification algorithm, a recursive Identification algorithm 
based on the maximization of the likelihood function is developed 
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In ■•ction 4. Th« algorithm makes use of certain sensitivity 
functions for the parameterized system. Section 5 shows how the 
sensitivity functions are generated and how to compute the sensl* 
tlvlty matrix. Thla sMtrlx provides Information that Is also 
useful with respect to the system's Ident If lability . In order to 
provide necessary stability requirements for tiie recursive algorithm, 
convergency conditions arc obtained In section 6, by the application 
of Lyapunov's second method and of a stability theorem concerning 
dlscrctc-tlme dynamic systeu . 

Two examples are given and results showing the Identification 
ant tracking carabllltles of the recursive algorithm are discussed 
In lectlon 7. 

2. Identification problem formulation 

The basic problem we deal with here Is the recursive Ident If 1- 

T 

catloi of a set of (m) unknown parameters p “ [p, ,p., . . p ] 
of the allowing (linear or nonlinear) dynamical system: 

i ■ JL li» E* (1) 

j 

where x ” [x,, x., . . ., x 1 Is the n-dlmensional state vector, 

~ X z n 

representing the solution of the set of flrat order differential 
equations (1) for given: (1) Initial conditions x (t~0) ■ ; 

and (11) (r) control functions ^(t), h ■ 1, 2, . . ., r. 

We are also tacitly assuming In the sequel that a solution vector 
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x(C)ce'* cxlats, lx unique, end Is stable. The existence of ell 

the derivatives 3fi/9x and 3fi/dp,, for ell 1, p ■ 1, . . n 

P J 

and j • 1, . . n is also assuned. 

Since in nost applications there is no direct way to measure 
all of the state vector components, the set of measured (or observed) 
data available for identification purposes, is given by: 

^ • Cx V (2) 

where ^ is the measured output (qxl) vector, C is the measurement 
matrix (qxn) , and v(t) is a (qxl) vector representing the inevi- 
table measurement noise. 

With re.'ipect to v, the following two assumptions are made. 
First, the me..'curement noise v(t) is an additive, Gaussian, white 
noise process, v(t)ix(t), with zero mean value: 

E{v(t)} - 0 (3) 

At least for the length of thi identification experiment T, this 
condition is considered true on an ensemble and time-average basis. 
Second, the covariance of the noise v(t) is given by: 

E |v(t)v’^(t-T)| - R^«(t-T) . Vt,T c(0,T) (4) 

This covariance is defined rather in a generalized, derived- 
martingale sense, being finite. We suppose in the sequel that 
R^ is unknown an>i is to be found during the identification process. 
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c 


The problca, Ch«n« la to us* th* (q) Mssured output functions 
snd the (r) kno%m and Mssured control functions to Identify and 
track uniquely and with an acceptable accuracy, the unknoim, 
possibly time-varying, elements of th* parameter vector £ " 

(Pj , • • • , p^) . 

The present state of th* art makes It feasible to develop 
the Identification algorithm in a discrete time version, since 
both the data and data processing are available in a discrete 
form, so that appropriate digital computers can be use>i for imple- 
m«ntation of the recursive parameter Identification. Therefore, 
the discrete versions of the controls, the state vector, the 
output vector, and the parameter vector are described in this 
paper as a sequence of discrete numbers, for all ie[0, N], N4 T/AT, 
Af being thr. basic time increment: 

u(i) - (uj^(l), U 2 (l), . . •• u^(l)l^ 

x(i) - [x,(D, x,(l), . . ., X (l)l^ 

^ ^ _ Vl-0, 1 N. (5) 

■ tyj^(i)i y2(i) 

£(1) - [Pj(i), P2(l) 

Similarly, we describe the measurement noise, as a random, 
zero mean. Independent Gaussian sequence, with: 

li{v(i)} - 0 

( 6 ) 

E |v(l)\^^(J)j ■ “ Kronecker's delta function) 

for all i,Jc[0, N] , as stated before in eqns. (3) and (4). 
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It is approprlats to reiaark at this point, that the Identification 
technique presented here can be easily extended, with slight modifi- 
cations, for the case when v(i) 1s s random correlated Gaussian 
sequence, thst is, a colored Masurement nc.se with given correlation 
functions. For clarity of presentation and to avoid cumbersome 
notations we prefer to treat throughout this paper only the uncor- 
related anu Independent Gaussian measurement noise case. 

With regsrd to the omdel assumed in eqns. (1) and (2), we 
should mention here that this model is by no means the m«.ot general 
one (see Mehra, 1970), but we deliberately adopted i, for the sake 
of conciseness and simplicity of notation. Nevertheless, the 
present algorithm Is compatible, with slight modifications, with 
the whole group of models for aircraft parameter identification, 
stability and control derivatives, as discussed in Mehra (1970) 
and in Stepner and Mehra (1973), Including the case when process 
noise may exist (Wingrove, 1974). 

3. Parameter estimation criteria and identification scheme 

Prior to the development of the recursive identification 
algorithm we have to restate in this paragraph our main objective 
and the rationale adopted for this study. There are several 
possibilities for the choice of the topological scheme of the 
identification, each of those schemes having certain merits and 
inherent disadvantages. Discussions of these topics have appeared 
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in th« technical llcerature, such In Aatrom and Eykhoff (1974), 

IEEE (1974), and Landau (1974). Although tha work of Aatrca and 
Eykh'rff (1974) la probably ona of tha OK>at objactlva and coaprehenalve, 
tna other raferancaa are alao excellent and up to data. Therefore, 
we will try to avoid unneceaaar 7 repetition and addreaa ouraelvea 
to the main polnta of the rationale, thoae relevant to the aequel. 

The output error method wax adopted for the development of 
our Idrntlf IcaClot. algorithm because, taking Into account the 
existence of tl ^ measurement noise, our main objective was to 
obtain unbiased estimates for the Identified parameters. Equation 
error methods are knotm to produce biased estimates In the same 
case. Moreover, the algorithm has to be able to cope with the 
problem of the Identification of biases (that possibly exist) 

In the measurement Instrumentation. The output error method can 
deal successfully with this problem also. 

It Is unfortunately true that In adopting the output error 
scheme one has to deal with essentially a nonlinear Iterative 
algorithm procedure. This fact Is at the expense of the output 
error scheme, since In the equation error method the unknown 
parameters enter the dynamical Identification equations In a 
linear fashion, so that the computational problem Is, at least In 
principle, simple to deal with. Nevertheless, remembering uhat the 
original aim vras to handle noisy nonlinear system Identification 
problems with, eventually, procesa noise additive Inputs, the 
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output error does not necessarily represent a prohibitive penalty 
froa the computational point of view. As sicntloned before, after 
Judging the appropriate alternatives the output error method was 
finally adopted. 

With respect to the identification criterion, our main 
objectives were: (1) to choose a mathematically tractable criter- 

ion so that the recursive algorithm would be easy to implement; 

(2) to obtain linear dependence between the parameter variations 
and the output error vector; (3) to generate the covariance matrix 
for the measurement noise as a by-product of the Identification 
procedure, in orde*’ to check the robustness, the sensitivity, and 
the convergence properties of the Identification process; and (4) 
to have a test for identif lability . 

Checking the different criteria, which were potentially able 
to correspond more or less to the above rationale, we found the 
maximum likilihood function as the best choice of criterion (Astrdm 
and Eykhoff, 1971, Mehra, 1970 and Kashyap, 1970) because: (1) 

maximization of the likelihood estimation function leads to 
unbiased, consistent, and minimum variance estimates as asymptotic, 
limiting values, under fairly mild conditions; (2) maximization 
of the likelihood function leads to the evaluation of the covariance 
matrix for the measurement noise; and (3) the change in the 
parameter vector is linearly related to the output error vector. 
Moreover, the recursive-type version of the identification algorithm 
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la aaally obtalnad froa tha batch typa Baxiaua llkallhood aatlution 
(a.l.a) algorltha. Thw a.l.a. aay provide tha covariance matrix 
for the Identified paraaetera, Indicating the corralatlon among 
them. It nay alao furnlah a uaaful teat and criterion Identlfl- 
ablllty. The n.l.e. criterion for recuralve Identification waa 
adopted alao by othar authoia (auch aa In Kaahyap, 1970, Gertler 
and Banyaax, 1974 and Hogera and Stelglltx, 1967) but, aa mentioned 
before, only for linear avitema. 

The conceptual diagram for the ayaten Identification la ahovm 
In figure 1, which uaea the following notation: 

1. For the (real) nominal, dynamical ayatem, whoac parameters 
are to be Identified, we use. Instead of eqns. (1) and (2), the 
equations: 


i(n) 'i 

(7a) 

»(n) ■ i(n) * i 

(8a) 


P./ \(t) being the nominal values of the (unknown) parameters, 
in) 

2. For the adjustable model, for a certain value £(t) of 
the parameter vector, the appropriate set of equations governing 
the system's model would be denoted by: 

i ■ il*» £(t), u(t)l (7b) 

X - C X (8b) 


- 9 - 


x(t) and ^(t) being Ch« beat avallabl* BK>d«l atat* and modal 
output, raapactlvaly . Wa aaauma that tha axact valua of x^^^(O) 
la unknown. Tha output arror la daflnad byt 

- C.x^^j(t) V - 2,(t) (9) 

Aa axplalnad bafora, balng Intarastad In tha dlacrata-form 
Idantlf Icatlon algorithm, and as a preparatory atap toward tha 
racutslva version of this algorithm, we will proceed further with 
tha batchad-typa formulation of tha Identification problem In 
discrete version. Hence, for every sampling Instant, we obtain 
tha output arror: 

a(l) - C ♦ v(l) - ^(1), lc(0, N] (10) 

which can be Identified as an Innovations sequence In the senoe 

defined by Gevers and Kallath (1973). It Is well known that as 

the sampling rate Increases, the probability density distribution 

function of the Innovations sequence's, rj^(l) tends to s Gaussian 

p.d. distribution (Kallath, 1969). 

Making use of the likelihood function approach, one has to 

find, that Is, Identify, the best estimate of £, namely £*, 

based on the measured output sequence Y 4 [^(^) , • • • , X^k) ] . 

The maximum likelihood estimate of £ Is obtained by the maxlmlza- 

k 

tlon of the conditional probability of Y , given £: 
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( 11 ) 


* 



t fluix pr 

£ 



Applying, ■ucccaaivcly , ch« Bayaa chain rule, one obcaina: 


■ax pr (Y*‘|£) 

£ 


k 

n pr 
1 1-1 




1-1 


( 12 ) 


Aa a matcar of convanianca, let ua now daflne (In pr (Y |£)] 
aa Che llkallhool funccl'*ti and, alncc the logarithm function la 
■onotonlc, we can write Inatead of eqn. (12): 

.*« jin pr(Y*^|£)| ■ max 

£ £ 


I In pr|£(l)|Y‘*^,£| 


(13) 


A.anumlng that x(0) la normally dlatrlbuted around 

baaed on the hypothcala made In eqn. (6), we Infer Chat pr(£(l)|Y^ ^,£] 
will alao be normal and, consequently, deacrlbed by aecond order 
ataclatlca. Therefore, thla quantity can be uniquely determined 
by computing the mean value: 

E |£(l)lI^'^£| 4y(i|l-l) (14) 


and Che covariance matrix: 


E{[£(1) - i(i|l-l)l(£(l) - idU-l))’’} 4 R(l|l-1) (15) 

A 

the quantity v(l)4(i(i) “ X.(ill~l)l being the "new Information" 
brought up by £(1). 

Taking Into account eqna. (14) and (IS), together with eqn. 
(13), we finally obtain: 
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£* m {£* j aax L(£,R)) 
£,R 


( 16 «) 


%rh«r« 


L(£,R) 


k 

y X /(l)R"^(i|i-l)v(l) ln|R(l|i-l)| (16b) 
1-1 


and: 


A 

nax L(£,R) - L(£*,R) 

£,R 

In eqn. (16b), |r(1|1-1)| in the determinant of the symmetric 
covariance matrix R(ljl-l) — to be vnrltten for brevity as R(l). 

It Is obvious from the nature of eqns. (16), that L(£,R) Is 
not explicit in £ or R and hence It Is not possible to determine 
directly t.he value of the vector £*, unless a proper Iterative 
naxlmlzatloii procedure Is used. In order to do that, let us 
assume that we are generating a trajectory corresponding to 

a certain value of the parameter vector £^y) * considered as tae 
best value known by us at this stage, and the nominal control u(t). 
In this case we Infer that, t]^( 1) and ^(1) are equivalent: 


being the current best estimate of likelihood 

function then Is: 
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I 


1 


*'(^(y)*’^(y)) " ■ 2 


k 

I 

i-1 




inlR^^jd) 


(18) 


Suppose now that being at the atage (y) . we ask for an Improve.l 

value of the parameter vector j " £(y) ^£(y)’^^^(y) '**^"8 

a small perturbation) in order to maximize the likelihood function. 
Accordingly, a new trajectory *(y+ 1) generated, corresponding 
to the new parameter vector £^^+1)^^^’ — (y-fl) close to 

X . (t) in a first order closeness sense. Let us now define: 

-(y^ 

assuming that the small trajectory deviation ^(t) can be repre- 
sented as a linear transformation with respect to ^^y) ’ 
eqn. (17) we can write the following: 

i!<Y+l)^^^ ‘ ^(n)^^^ " ^(Y+1)^^^ 

- r^d) - CS^^j(l)^^^j (20) 

We will call the (nxm) matrix the sensitivity matrix, 

in the sense defined by Sldar (1968) and Larson (1968) and we will 
show in the sequel how this matrix is computed. 

The value of the likelihood function is actually a function of 

A£ and R: 
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1^ 

L(£ ♦ ^.R) • - j r “ CS 

- CS^^j(l)A£^^j| ■»• tn|R(l)|| (21) 

In order to maximize this function with respect to A£ and 
R, we shall calculate the partial derivatives of L(£,R) with 
respect to the vector A£ and with respect to the matrix R(i)> 
Setting those derivatives equal to zero, one obtains, after a few 
algebraic manipulations, the following nece sary conditions for 
maximization of the likelihood function: 

k k I 

r |s’'(i)c'^R"^(l)CS(i)|^*. V - L |s'‘’(i)cV^(l)n(l) (22) 

1 - 1 ' ' 1-1 


and 


k . 

L R(l) 
i-1 


k 

L 

1-1 


Had) - cs(i)A£*^j 





(23) 


Those two coupled equations allow us, in principle, to 
establish a batch-iterative procedure, in order to compute 

A 

and R(i) (Grove, Bowles, and Mayhew, 1972 and Aubrun, 1971). 
Computationally, this can be done only by assuming some simplifica- 
tions as did Gertler and Banyasz (1974) and Grove, Bowles, and 
Mayhew (1972); otherwise one has to deal with very laborious 
manipulations, including some Intermediate iterative algorithms. 
Since we are not interested hen: in obtaining an explicit form 
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for the identification algorithm in the batch-formulated case, we 
will proceed further, in order to obtain the recurelve version of 
the maximum likelihood identification algorithm. 


4. The recursive identification algorithm 

In this section, the recursive version of the identification 
algorithm is derived from the previous necessary conditions (22, 23). 
In particular, the optimal parameter vector increment would be 
obtained from <qn. (22) and we shall assume in tho sequel that: 
k >> 1 and that the sampling rate is high '‘.lOugh, that is, AT 
is small in comparison with the process dynamics. From eqn. (22), 
defining Agj^ 4 note that for the Interval (0,k) one has: 



- I^[s’’(l)c'^R’^(i)ri(l)] 


+ s’^(k)c’^r^(k)ri(k) 


(24a) 


Since eqn. (22) is the m.l.e. necessary condition, valid for all 
k, it certainly holds as well for the interval [0,k-l], so that: 



To establinh a recursive algorithm we ask for the following 
condition: 
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for (0,k-l) 


/ * 
.. . i 

/ iii! 


^ - 


for [k-l,k] 


( 25 ) 


Condition* (25) and eqn. (24b) imply that (24a) has the form: 
k-1 

^i:^|s’‘(i)C^R'^(i)CS(l)|A£*_^ + |s^(k)C^R*^(k)CS(k)|6j2* 

- r |s^(i)C^R"^(i)CS(l)|A£^_^ + |s^(k)C^r^(k)ri(k)| (24c) 


From (24c) we obtain the change 6£ (k) in £(k) for the 
Interval [k-l,k] needed to identify and perhaps track the 
parameter vector: 

6£^ - |s’*(k)c'‘’R"^(k)CS(k)j"^ •[s‘^(k)c'‘T^(k) n(k)| (26) 

or, in a recursive form, the following identification/tracking 
algorithm is obtained: 


£(k) - £(k-l) tA]’^tB)£(k) 


(27) 


where: 

IB] - [B(k)l 4 s'^(k)c'*’r^(k) 
is an (mxq) matrix and: 

[A] - (A(k)l 4 s’’(k)c‘^r^(k)CS(k) 

- an (mxn) matrix, is the incremental Fisher Information matrix for 
the unknown parameter vector. 


c-1 

Th« Inverse coverience aetrlx R (k) can not be obtained 

directly froc eqn. (23). Therefore, we will first derive a 

* 

recursive equation for R(k). Froa (23), we no"e: 

k » k-1 

I R(l) ' L R(l) + ii(k)fi(k)^ ( 28 a) 

1-1 1-1 

, k . 

Defining the matrix R (k) 4 r X R(l)t we %nrlte, from (28a): 

o * 1-1 

k»^(k) - (k-l)R^(k-l) + ri(k)ri(k)^ (28b) 

and finally: 

^ ( 28 c) 

This recursive equation is of utmost Interest because In the steady 
state (k >> 1) of the recursive Id 'notification, assuming satis- 
factory parameter tracking, it allows us to Identify the covariances 
of the Instrumentation noises. That Is so because for large enough 
values of k, we have already obtained a good estimate for the 
parameter £ which is very close to that: 

tim R (k) - R(k) - R, 
k»l ° ^ 

(see eqn. (18)) 

In all the cases we studied, this result was verified, a veilflcatlon 
that represents bv Itself a good test of and criterion for the 
acc iracy of the Identification process. 
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— 1 

Since eqn. (27) needs R (k), one ie interested in the recu- sive 

equation of the inverse covariance matrix. This matrix can be 

* 

obtained either directly, by inversion of R^fk) obtained from 
the recursive algorithm (28c), or by making use of the matrix 
inversi?*; lemma. Assuming steady state conditiono, we obtain the 
following recursive algorithm: 

r^k) - ^ R“^(k-1) R‘^(k-l):inV^(k-l) (29) 

(k-1)^ 

It is clear from eqn. (27) that the existence (for all k) of the 
inverse of the incremental information matrix, (A(k)] is 
necessary for the implementation of the recursive identification 
algorithm. The computation of [A(k)] ^ is by itself an excellent 
test for identif lability . Its existence constitutes a good 
criterion for detection ill-posed identification problems (see 
Aubrun, 1971 and Glover, 1973). We therefore assume from now on 
that the inverse matrix [A(k)] ^ exists, such that the identif lability 
conditions are met. 

Note that there is a formal similarity between (27) and other 
linear least-square gradient-type iterative algorithms, although 
our algurlthms (27) and (29) are different and able to handle non- 
linear systems in recursive identification problems. 

For the start-up procedure of the recursive algorithm, we are 
assuming that £ priori estimates £(0) of the parameters exist. 
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obtalrad from early meaauremcnCB, or from auch experlmcnta aa 
wind tunnel niea8'<’'''menta in the caae of atablllty and control 
derlvativea for ali raft. Beginning with thoac initial values, 
the follotring sequence of computations is done for each interval 
Ik-1, kl: 

1. y(,f)(k) is obtained either directly from real experiments 
(on-line or off-line) or, in the case of simulation studies, from 
the integration of the differential equations of the nominal 
systems (7a and 8a), 

2. in order to carry out the computation of £(k) , the 
computation of S(k) is necessary, following the procedure shown 
in the next section, 

3. 2 .(k) is calculated from eqns. (7b and 8b), the value 
of the parameter vector being £(k-l) . The vector £(k) is 
calculated from (10) and is used in eqns. (27,29) in order to 
compute the new value of the parameter vector £(k) . 

4. £(k) is calculated from eqns. (27) and (29), which are 
the basic recursive equations for the parameter identification and 
tracking, with £(0) as the initial value (the best available 
guess on an a priori knowledge basis). As vrill be shown later, 
convergence of the identification algorithm can be guaranteed 
under the hypothesis that £(0) is close enough to £* (although 
the convergence region in the parameter space is quite large). 
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Th« ■chemacic flow diagram of Cha computaCiona nacaaaary for 
Implemancation of Cha racuralva Idancif Icatlon algorithm ia ahovn 
in figura 2. 

From aqn. (26), it ia aaay Co prova Chat for k>>l and given 

* 

* Of one obcaina: E(£p^] ■ 0. Thia reaulc ahowa that Che 

oa* ameter vector £(k) , identified by Che algorithm (26), ia 
unbiaaed. Furthermore, aa we mentioned before, one obaerved from 
eqa. (28c) Chat the iterated covariance matrix R(k) Cenda to the 
noiae covariance matrix aa k increaaea. Thoae are two 

valuable reaulta obtained aa a direct conaequence of ualng the 
maximum likelihood eatlmation approach. 


5. The senaltivlty matrix 

Aa we noted before, uae of the recuraive algorithm (27) 
requires the computation of the sensitivity matrix S(t). The 
(n.m) elements of S(t), the sensitivity functions Dx^/dp^, 

V i«l, . . ., n and J*l, . . ., m, are by themselves solutions of 
(nxm) differencial equations. Those differential equations are 
obtained from the system's dynamic equations (7b), assuming the 
current value of Che parameter vector by taking the derivatives of 
Che equations with respect to each parameter p^ : 



£ 

6-1 


3f. 


3x, 


3pj 



( 30 ) 
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Sine* «qn. (30) dMla with a coablnad llnlclng procaaa with 
raspact to dt and 3pj (both tand to zaro) , and alnca wa already 
aaauaad Cha conClnulvv of tha aolutlona with raapact to £ and t, 
wa may Invart tha ordar of dlf farentation (aea Sldar, 1968, Laraon, 
1968), obtaining: 


dt 



- L 

B-l 





(31) 


Danotlng dx^/dp^ 4 ** acnaitlvlty function, we have: 


■ij 


n it, 

- r — - 
6-1 '*6 


3Pi 


(32) 


or in a compact matrix form: 

S(t) - F S + F 

X p 


(33) 


where : 



12 


S 4 



(34) 


"nl “n2 



F^, the ayacem'a Jacobian (for the current value of £) and F^, 
are defined below: 
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( 35 ) 


f 4 

X * 







■ 

• • • 


aPl • 

s 

e 

e 

'o 4 

a 

e 

e 

e 

P 

e 

e 

if 

if 


if 

if 

n 

n 


n 

n 

.'*1 ' 

e e e i\ 

3x 

n 

(nxn) 

_aPi 



(nxm) 


Therefore, to obtain the matrix S(i) It la neceaaary to 
Integrate (n.m) additional differential equatlona, an operation 
that demands a certain computing effort, but does not represent a 
difficult task for a high speed digital computer. Gupta and 
Mehra (1974) and Denery (1971a) have shovm that, for linear systems, 
some savings In the computational effort of solving eqns. (33), are 
possible. 

The Initial conditions for the Integration of the differential 
system (33) are s^j ■ 0. 

6. Conditions for convergence 

The best available policy of changing £'.k-l) In order to 
track. In an optimal way, the trajectory *(„) (*^) measured 

output vector £(k) , Is given by applying the recursive algorithm 
(27). In the parameter space p", this la equivalent to the choice 
of the best direction In order to converge sequentially to £^^^(C)> 
The size of the step 6p^^, in the optimal direction, has to be 
chosen In a way such that convergence can be guaranteed. That 
means that the trajectory tracking error (discussed below) has to 
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b«, At a non-incr«aslng function. Tha fundaaantal problua 

of chooalng tha optlaal atap In nonllnaar programing itarativv 
achaaaa haa baan widaly traatad in tha litaratura (aaa, for inatanca, 
Luanbargar, 1972, Bard, 1970, and Mahra and Gupta, 1974) and we 
will not traat it again hara. 

Wa ahall rathar preaant a apaciflc critarion for convargance 
baaad on Lyapunov'a aacond aathod. SoBa%rhat aiailar raaulta have 
alao been obtained by ua, aa aho«m latar, by developing an alterna- 
tive criterion baaad on tha location of I'Sa aigenvaluea of tha 
output vector tracking difference aquation. A aucceaaful applica- 
tion of Lyapunov'a direct method in order to obtain atable adaptive 
achemea for ayatem identification la due to Narendra ar i Kudva 
(1974). Mendel (1968) atudied tha atability prupertiea of a 
parameter vecto** difference equation by applving Lyapunov atability 
theory- Here we deal with tha atability and convergence propertiea 
of the atate vector tracking error difference equation. The ata- 
bllit/ study of this tracking error sequence by the means of Lyapunov's 

method reveals it to be a very valuable tool for choosing the 

scalar p(k) in the modified identification algorithm: 

£(k) - £(k-l) + p(k)lA(k)l‘^(B(k)ln(k) (36) 

Let us define the following positive definite function: 

- ^^(k) • ^(k) (37) 
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%iher«t 


«ji(k) - *(k) 

aa a posaibla Lyapunov t'unction. For to ba a Lyapunov function 

for tha racuralva Itarativa algorltha, tha nacaaaary condition la: 

4 «x‘^(k4-l) • 6a(k-»-l) - ^^(k)6x(k) <0 (38) 

Tha quantity can ba aaally calculatad fro* (7,8,9, and 36). 

2 

By naglactlng hlghar-order Inf Inltaalmal tama containing AT 

(aa AT tanda to zero), and aasunlng a nolaa-frea caae, we finally 

obtain: 

AVj^ - - AT ^^(k) M(p) ^(k) (39) 

with M(o) ■ P pQ, P and Q being two aynmetrlc (nxn) matrlcea: 

PAP + P ^ (40a) 

* X X 

Q 4 Fp a"^ BC + |Pp a"^ Bcj^ (40b) 

The proper choice of the Iterative gain p, hua to guarantee 
that M(p) la a poaltlve definite matrix, auch that la Indeed 

a Lyapunov function for the Identification algorithm and the 
Iterative proceaa la globally aaympotlcally atable. Making uae of 
Sylveater'a Theorem, on poaltlve deflnltneaa teat, the choce of p 
and be made either o.i a per atep baala, or globally prior to the 
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Idantlf Icatlon test# The second approach la onich easier to apply 
because It Is based on an a priori data base, avoiding unnecessary 
additional computations. 

The stability analysla Is based on two assumptions* (1) we 
are assuming fixed or slowly changing parameters and (2) as mentioned 
earlier, zero output noise. The Impact of the noise covariance 
on p Is presently under study by us, but Is not discussed here. 

As mentioned before, an alternative way to Insure convergence 
of the Identification algorithm Is by studying the stability of 
the follovdng difference equation, obtained from (7, 8, 9, and 36): 

^(k+l) - (I - AT • N(p)l ^(k) - N(o) ^(k) (Al) 

where: 

N(p) 4 (F + pFpA'^C] (42) 

Is a real, square (nxn) matrix. The scalar p Is to be chosen 
such that N((>) (41) has all Its eigenvalues Inside the unit 

circle. A theorem In Jury (1974) provides the necessary rnd 
sufficient conditions for stability for the system (41,42). The 
proper value of the scalar p can be calculated from these con- 
ditions. Again, as mentioned before, p can be determined for 
each Interval or, prior to the Identification test. In a very 
simple way, avoiding cumbersome computations. 
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Applying cither the Lyapunov otahlHty appria':h or the etabillty 
criterion for the difference cqn. (41), we have been *ble to o^..allt 
an algorithm which: (1) la atable, (2) provides high accurate 

Identification, and (3) rapidly tracka changing parameters. 

7. Computational results 

In order to Illustrate the utilisation of the recursive algorithm 
and the results which have been obtained, although taking into 
account the lack of space, two examples among other cases studied, 
will be presented. 

Example 1: 

The Identification and tracking of t%ro unknom parameters In 
a first order, nonlinear system: 

X + ax bx'* ■ u(t) 

y ■ X + V (43) 

with: 

x(o) - 0.5 , n - 0.4 , b - 0.2 (43) 

ftion non 

Although this is a relatively simple case, the purpose la to 
allow the reader to better evaluate the utilization of our algorithm. 
Twelve different cases were analyzed. Including the use of various 
Inputs and various combinations of variable parameters. We Identi- 
fied a and b assuming that: 
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1. both a and b are unknoim, but conatant paramecara. 

non non 

2. a varlaa. but b remains constant. 

noB noQ 

3. a la constant but b ^ changes. 

non non 

4. both a and b are changing, simultaneously. 

non non 

In each case the Identification was perfomed with three different 
Input functions: (1) u(t) ■ 2.0 (step); (2) uft/ • 2 + sin t; 

and (3) u(t) - 2 4- n(t), n(t) being a white, Gaussian noise Input 
with zero mean and covariance 0.4. The covariance of the output 
noise was 0.04. 

The Identification period was 20 sec (real time). The results 
obtained were excellent from all points of view: (1) convergence, 

(2) accutacy of unbiased estimates, (3) tracking and, (4) Insensi- 
tivity to Initial guesses for a and b. 

In figure 3, as an Illustration, the recursive Identification 

and tracking of h Is shown for the case where a Is constant 

notD 

but b changes and u(t) *2 4- sin t. Note the slmultanecus 
nom 

Identification of the noise covariance Rj^(K). 

Example 2 

The recursive (on-line) Identification (and tracking) of the 
stability derivatives of the longitudinal dynamics typical of 
aircraft. In this case, the nominal system Is the third-order 
linear system, represented bv the transfer function: 


itsi 

«(S) 


2.857(5 4 0.4) 


S(S 4- 0.685S 4- 0.53) 


(44) 
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wh^re 6 (t) ia Cha aircraft's pitch angla (deg); 6 (t) la the 
elevator angle (deg); the longitudinal natural frequency la 
0 )^ “ 0.73 rad/sec, .ad the danplng ratio la ( * 0.47. In state 


variables notation, similar to the notation of 

(7) and ( 8 ), we have: 

6 ■ £ 

(45a) 

q-M q + MUa + M, d 
q w 6 e 

(45b) 



. 

a ■ q "f Z a + - 77 - • 6 
^ w U e 

(45c) 


T 

We note that X (t) 4 state vector for this 

example. The numerical values of the coefficients are: U ■ 215 ft/sec, 

M - 0.2778, Z • 0.4075, M. - -2.857, M - 0.0019, and 
q w o w 

noro nom e 

Zj - -13.24. 
e 

For Identification purposes, one measures the pitch rate q with 
a rate gyro and the angle of attack a with an angle of attack 
sensor (vane). Both the rate gyro and the vane havj measurement 
noise assumed to be a Gaussian white noise wfth zero mean and 
covariances of 0.1 and 0 . 2 , respectively. 

The Identification Interval was 22 sec with 100 discrete 
Intervals per second. For the sake of simplicity and clarity we 
show only the case where H and Z are to be Identified. Twelve 
different combinations were analyzed: 

1. both M and Z are unknown but constant 

q w 

2. N Is variable, Z Is constnat 

q w 
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3. M Is constant. Z Is vsrlsbls 

q w 

4. both and Z^ srs varying slmultanaously 

Paranatsr idantlf Ication and tracking waa dona for thraa 

diffarant inputs: 

1. d(t) " - 1.0 dag. (stap at t - 0) 

2. 6(t) - - 1.0 • 0.25 sin 0.3t - 0.1 sin 0.9t - 0.02 sin 1.5t 
This input waa considarad as tha optimal input for batch-idantif ication 
and calculatad according to Nahra (1973). 

3. «(t) - -1.0 + n(t) 

n(t) baing a whita, zaro maan, Gaussian noisa %^th covarianca 
aqual to 0.5. 

Bacausa it %rould ba impractical to show all our results here, 

only those obtained for recursive identification and tracking in 

three cases are shown in Figs. 4, 5, and 6. Inputs (1), (2), and (3) 

above, each in conjunction with the combination that has M and Z 

q w 

varying simultaneously, make up the three cates. No sensible 

differences are observed with respect to the various input functions. 

It is worth remarking that the identified values of M and Z are 

q w 

unbiased. Furthermore, the figures show how accurately the algorithm 
identifies and tracks even the varying nominal parameter, after a 
short transient. 
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Conclusions 


An itsrstlvs rscursive slgorlthm for psrsmecer Identlf icstlon 
and cracking, based on Che nuixlmuia likelihood approach, was developed. 
This algorlcha allows sequenClal paranecer and InsCrusMnC noise 
IdenClf IcaClon In boch linear and nonlinear syscems. The esClmaCes 
are shoim Co be unbiased and accurace and Che resulcs already 
obcalned In several cases sho«. a good ablllcy Co crack varlaclons 
of syscems paramecers. T.ie condlClons for a scable-lceraclve 
process are analyzed, leadlnt\ Co Che choice of Che scalar Iceraclve 
gain p. 

EsCabllshlng bounds on Che value of p or decermlnlng 
relaClonshlps beCween Ic (or perhaps a gain macrlx G) and Che noise 
covariance R, Is a Coplc for furCher research. Also, IC may be 
possible, on-line, Co generaCe InpuC, cr adequaCe probing sequences, 
funcClons ChaC would maximize IdenClf IcaClon accuracy, perhaps 
explolclng Che Cheory developed by Lopez-Toledo and Achans (1974) 
for linear syscems. Maximizing Che InformaClon macrlx may provide 
necessary condlClons for generacing such InpuCs for Che IdenClf Ica- 
Clon, even of nonlinear sysCems. 
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Figure 1. System identification — conceptual design. 





Figure 2. Simplified computational flow diagram. 
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Exaaple 1: identification of a and b(t). 


CASE-10 LONGITUDINAL DYNAMICS F-4J 
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Figure 4. F.xanple 2: Identification of the stability derivatives 

with input 6(t) ■ - 1.0. 









CASE-12 LONGITUDINAL DYNAMICS F-4J 




50 


e 

, PITCH 
ANGLE, 
deg 


Figure 6. Example 2: Identification of the stability derivatives 

with input 6(t) - - 1.0 + n(t). 



